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SIGNAL PROCESSING BY MEANS OF RESONATORS 
TECHNICAL FIELD 



The invention concerns signal processing systems 
5 for signal processing. 

BACKGROUND OF THE INVENTION 



comprising resonator arrays and schemes 



The market of computing expand^tapidly in pervasive computing devicesC^ 

as trer-Odevices). As these devices wiUbepartofahnost every aspect ofourlife.andas the 
ftuK:trons of these devices will become increasingly complex Jt is mandat^^ 

interaction between man andmachine mimics the ways humans interact with each ot^^ 

T1.US there isaneed of simplesignalpr^g^h„i,,es.e.g., for theproce.^^^ 
or other audio signals. 



There are many other areas where there isademand for better Signal processing systems 

^-P^--hearingaids.speakerrecogmtionsystems.noisesuppressionsystems,an^ 
15 systems that aUow a speaker to control certain functions of ; 

machine, or apparatus, and so forth. 



20 



a computer, device, vehicle. 
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Signal p.««stog ^ic^y i,^^ ^ ^ ^ ^ ^ 

*=s«ad«d.pp,„acl.U«i„pu,sig,«lisfe,Wom«di«od,efi«,„«cydo„uin>«i^ 
well b,„™ Fa,, R^er Wonn (FFT) .Igoriftms. I. fte ft«,«„cy don* 

«nple„«autio„ of Ite fllttr op«adoo is accomplished by a mulaplicadon of fte fil,., 
.esponsc funcUon jO, U,e Wonned i„p« signal. A fU,e,«, do,^ o„,p„, ^ 
fte„ ^ve«. by means Of a subse<p«n, inverse FFT operaUon. AiUK,„gh extteraely 
c«r.c«„. alg«i,hms are known for implen»nling U,is app««ch i. snffen, fton, a number of 
fundamental deficiencies. The FFT formation is a non-local operaUon in *e lime 
domain. This means that an intrinsic <ime delay is inuoduced which is inver^ly 
pmportional » U,e ftequency ^soluUon of *e ttansfom,a„on. In o.*r to avoid distutbing 
echcng effects the Ume delay should typically not exceed la" s in audio applicaUons which 
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corresponds to a frequency resolution of 100 Hz. at best. In order to achieve sufficient 
frequency resolution for a satisfactory synthesis of the filtered signal one must resort to 
complex phase analysis methods which substantiaUy increase the computational effort 

Standard signal processing techniques are computationally expensive and are thus not 
5 suited for use in voice recognition or speaker recognition as implemented in some tear-0 
devices such as smart cards. 

Similar problems occur in today's hearing aids, where specified spectral regions are 
amplified. For tiiese appKcations the time delay is particular detrimental, because here tiie 
original and the processed signal overlap, and thus smear out tiie subtie time information. 

10 It is a disadvantage of known systems that tiie time resolution is not high enough to provide 
reliable cues for use by speech recognition systems. 

It is an object of die present invention to provide an improved signal processing approach. 

It is an object of the present invention to provide an improved signal processing approach 
which is suited for use in hearing aids. 

15 It is an object of tiie present invention to provide an improved signal processing approach 
for use in speech recognition or speaker recognition systems. 

It is an object of tiie present invention to provide an improved signal processing approach 
for processing acoustic signals. 



r 
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SUMMARY OF THE INVENTION 

Tl-pn^nt invention concemsamethod, signal processing 
element, and a computer program product as claimed in the claims. 

Advantages of the pr^nt invention ai^ either expUcitly addressed in the detailed 
descnption or are obvious from the disclosed. 
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DESCRIPTION OF THE DRAWINGS 

The invention is described in detaU below with reference to the foUowing schematic 
drawings. It is to be noted that the Figures are not drawn to scale. 

FIG. lA is a schematic block diagram of an embodiment, in accordance with the 
5 present invention. 

FIG. IB is a schematic block diagram of another embodiment, in accordance with the 
present invention. 

FIG. IC is a schematic block diagram of another embodiment, in accordance with the 
present invention. 

10 FIG. 2 is a schematic flow chart that is used to iUustrate aspects of the present 
invention. 



FIG. 3 
FIG. 4 



FIG. 5 
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shows the hearing threshold of an impaired ear relative to normal hearing. 

is a schematic of loudness growA in normal (soUd line) and impaired (dashed 
Une) ears used to illustrate recniitment denotes the intercept point for 
equal loudness perception of nonnal and impaired hearing. 

is a schematic that shows tiie adjustment of die amplification in a hearing aid, 
according to the present invention, depending on the spectral sound intensity. 

(a) Amplification vs. frequency is equal to the hearing threshold curve of the 
impaired ear for a white noise input spectrum with an intensity of 0 dB 
(heaiteg threshold for normal hearing). 

(b) Same as (a) but now the input intensity is P = 50 dB corresponding to the 
loudness of a nonnal conversation. To account for recruitment the 
amplification curve must be re-scaled by a factor of (I - P/P^ = 0.5) 

(c) The spectral intensity of real sound signals is non-uniform. 
Correspondingly, the scale factor is frequency dependent giving the 
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amplification curve an entirely different shape from the original threshold 



curve. 



FIG. 6 Is a schematic drawing of an embodiment of a hearing aid in accordance with 
the present invention. 



5 FIG. 7 
FIG. 8 



Shows exemplary elements of tiie unit 61.i in Figure 6. 

Is an alternative embodiment of a hearing aid using a set of pseudoortiiogonal 
basis functions which are derived from die resonator transforms by means of a 

linear transformation. 

FIG. 9 Is a schematic block diagram of an embodiment of a hearing aid in accordance 
with the present invention. 

FIG. 10 Is a schematic block diagram of another embodiment of a hearing aid in 
accordance with the present invention. 

FIG. 11 Is a schematic example of a general resonator in accordance witii the present 
invention. 

15 FIG. 12 Is a schematic embodiment, in accordance with the present invention 

comprising a resonator array with a plurality of resonators as shown in Figure 
11. 

FIG. 13A Is a pseudo-code representation of a possible software implementation of a 
generd damped (harmonic) resonator array in accordance with tiie present 
2^ invention. 

FIG. 13B is a continuation of the pseudo-code representation of Figure 13A. 
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DESCRIPTION OF PREFERRED EMBODIMENTS: 

Thebasic concept ofthe present invenaon and some basic tenns and expr««io^ 
desCTibed in the following. 

A"»°^i"'benK».basicse„seba«l«i,effltertedampsorsupp,esses<«,ato 
flequeac^s. A ,«o„ator be described or characteed by iB .espoose ftacdoo The 
.esponse ftncUon describes U,e filter cha«cteristtc (a« ta,„eocy dependent attenuadon 
and phase shift) of a resonator. 

Ttae are ^any ways to realize a resonator. A o-cchanical or ntoo-mechanical ^senator 
for example might comprise a cavity or hollow body which vibrates sympathetically with 
10 another vibrating system, such as the air through which an a,«iio wave is traveling Tie 
.^onator can also be hnplen>en.«l by means of micto-mechanical approaches using 
mechanical resonators such as cantUevers. 

Micromechanical systems comprising cantilevers are weU known and easy to make 
Exrstmg semiconductor techniques can be employed, m essence, the techniques of 
mrcromachining arc employed to create cantilever arrays. Details on how to make such 
anays are descnbed in co-pending patent application PCT/IB95/00817 which was 
published on 10 April 1997m.derpubUcation number WO 97/13127 and in co-pending 
patent application PCT/IB96/00636 which was fried on 3 July 1 996. The resonance 

fiequency of each cantilever of the cantUeverar^y is well defined such thataresonator 
anay is obtained which has resonators with well defmed Q-factors and resonance 
frequencies. 

Bridges or memb^es can be used instead of cantilevers. It is also conceivable toemploya 
combination of cantilevers, with bridges or membranes. 

If a micromechanical resonator array is to be used in connection with an electrical signal 
processing circuito^ (e.g. a reconstr^ictor which assigns weights and superposes the 
weighted signals), then the mechanical signals (vibration of the micmmechanical 
resonators) has to be transformed into electrical signals. This can be done by means of 
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»^edd«^.„,s.W.Us„i,eda«pi«<«,.c«corpiezo,«isaved««<>rs.E«mpI«=,e 
given m above-nwiaoDed co-peiKUng PCT appUcations WO 97/13127 or 

Pcr/m9dA)0636. ^i^.'-^n.^.^^^^^^^^^ 

used to iraiitfonn vibmioMl movemem into electtical sig^ 

A mechamcal Ksonator can also be realized mtog a system of springs. 

Aresonatorcan beinvlen^nted by n«ansof analogelecdonics using imp«b«:e 
capacitors and tedstors. In addMon. active devices sud. as MOSEETs ddven below 

switclungttaeshold can be used u>ampUfysig^A«sona.or can also be realized bya 
filter that blocks high fiequencies and ano«« niter that blocks low flequencies. If these 
twofi,.„sa„=co„pWi„a,^^^„^„,^^g,_^^_^^^__^_,^^^ 

supen«s.t.on of die response fi»„:ti„m of the two fdters. This filterresponse function 
might have a Shape that is compa^bl. .o the shape of a resonator's .espouse ftocdon. 

l^wise.,esonato.canalsobein,p,en.cntedina«»pu.ersys.en..«ingso^ 

that embodies algorithms. 

A resonator can also be realized as a combination of any of the above-described 
approaches. 



All p^cdcaltesonatotsshowaloss of eneigy due to action (iutemal or external) or od^r 
-s^tance. This is called dan^g. Tie resulting decease in amplitude of tt» syaen, is 

known as die decay. T1,e te™ damping. d,en. is .estHcted to the system itself, «her than 

^ •» lie sound oflhe system in an environment 

Decay is fl» p„«^ whereby the amplitude of osciUadon of a vibrating system (such as a 
■esonator) diminishes wid, time due to a loss in eneigy. loss of enetgy is what is 
usually called damping. Tie decay constant . (also known as decay time) is d« time 
requi^d for the amplitude of a vibradng system te decease to approximately 37% (or 1/e) 

of its initial value. 
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A resonator - when set in motion - vibrates both as a whole, with a frequency called the 
fundamental, and. with lesser intensity, in sections as weU. If these smaller lengths are 
integer fractions (1/2, 1/3. 1/4. ...), their frequencies of oscillation are caUed harmonics and 
are integer multiples of the fundamental Other resonating fiequencies which are not whole 
multiples of the fundamental may also be present, and are caUed partials or inhamionic 
resonating fiequencies. A resonator vibrates as a whole and damps or suppresses certain 
frequencies. That is. a resonator has some sort of a filter function. 

The present scheme makes use of the fact that an arbitrary time domain signal A(0 can be 
approximated by a linear superposition of response functions of resonators, and in 
particular Ix,rent2ian resonators, with resonance fi^uendes and Q-factors chosen at will. 

The present scheme can be realized in a computing system such tiiat the response functions 
are generated by numerical integration of second order differential equations which are 
associated witii the resonators or Lorentzian resonators. This is numericaUy efficient and 
avoids problems which are encountered witii the FFT approach, namely, time delays can be 
made negligible and the fuU spectral information is preserved, viz. there is no limit on the 
fiequency resolution. The present scheme is real-time and first results are available right 
away. This is important for hearing aids, for example, where delay leads to echoing. FFT by 
comparison is a global transform approach tiiat provides results with some delay. 

Audio signal processing systems form the basis for signal enhancement and noise reduction 
in a variety of voice related applications, such as speech recognition, speaker recognition 
and voice syntiiesis. The present scheme using a resonator anay serving as dynamic filter 
array provides a powerful architecture for the implementation of algoritimxs tiiat closely 
match signal pro<^ing in natural hearing and speaking. This property is considered to be a 
major mnovative step leading to a new class of Audio signal processing systems (audio 
processors) tiiat improve the overaU performance of future voice products. For example, 
speech recognition relies on a front end that transforms the voice signal into a set of 
descriptors (termed cues) of the properties of the signal. The quality of the cues is 
extremely critical for the robustness of the system in terms of speaker and environmental 
dependencies. The results that can be obtained with current systems are far from 
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satisfactory. The dynamic filter anay. accordii^g to the present invention. aUows to 

construct efficient algorithn^for generating better descriptor sets, in paxti^^^ 
respect to noisy environments, e.g.. voice computer communication in cars. 

Tlie present scheme can also be used forprocessingof Signals other than audioorvo^ 

signals. Inother words, thepresent scheme can be used in many different lands of sig^^ 

processing systems. 

Acco«li„g«,aepresea,invenaon.antapu.sig„alMWis,eceivedviaa«^^ , ^ 
analj™ibyasignalp,oc«>sfagsystem2minga(dafflped) ^0,^,5 ^ 

shown in Fig«„ 'C'"««-Ple). staples. fom> of ' 
hannonic oscillator, whicli follows the differential equation 

Where B,0 is ti« response ofu. i* r^or and Mf,; is <he input signal (e.g.. a voice 
■np" Signal), oj, are the resonance frequency of a,e i-d, resonator and r, is dK 
15 «>™sf»nding decay constant. The Q-fector is defined by e = cn-/2. 

Tl« resonator can be in^femented as an algoriUm, for digital con,».eB using Verie, 
algondun. for exan^Ie. to solve the differential equation for the resonators of array 9. 

Where A is the dis<5ttization Ume Step. 
20 The frequency response of the damped harmonic oscillator is 
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I.isno,™Bzed» 1 at U..re.o„^c.f^ue,«y.„h«ea,e absolute valu. of U»,«p„n« is 

maxmun. For >^ <„, an,pUB«ie ,«po,«. decays as -Jr and for n, ^< n,, d.e 
amplitude response decays as - Jr^. 

Tbe .esponse of an array of resonators 9 is weighted „iU, ^ (^jg^^ ^ 
n.ay depend on resonator. i.e. iB ,re,^„cy^ = <M2.. and *e toe Tie weigh. 

fto«sn>ay be calcnbtednsingson^ formalism fto„«„a«„a,inp„signalA,«in order .0 
r^pond to *e insan.an.ous e„vironn,e„L As a„ exan,ple one nigh, exploi. U>e quasi 
penodic nahne of vowels, by using a piteh dependent oscilUtory an>plificaUon, to enhance 
cctan. speakers above noise level, weighdng of signals is schen^caUy illusttated 
by means of weighting „ni.s 3. 4, and 5. Tlese weighting uni.s 3-5 are pa« ofa so.:alled 
reconstructor 8. 

Tl« weighting n^y be such ti,a.cha«ctedstic speech sounds are optimally separated fton, 
otters and from background noise. Using U,e weighted response n,ay direcdy ide«ify 
different vowels and classes of consonanB. 

15 Likewise, U« weighs can be consent U«ler certain d,cun«.ances one or mo« of ti. 
weights might even be equal to 1, i.e. Wi = l. 

Mowing equation dte superposition is a san»atioo of ti,e / weighted .esonator signals. 
C(()=5;Wi(r)S,(,). 
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(4) 

Thesupe,position^i.donebyasupe.p„sitio„ci:cui.6d«.ispa„„fti,e^^^„„ 
r 

Note tia. in the presen. contex. fte word supeiposition is used to describe any 
matematical operation (adding, subtiacting. multiplying, dividing, and so c„) u,a. is 
employed to process .he / weighted ,esona.or signals such ti«. M ouqn,. signals Q,, are 
obumed. where M s M (in o.her words M = 1. 2. ...). P„ferably. M<N 
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lu« 1 1 and analj^ fcj, , ^ p,^^ system 12 using , rcsc^ array 1 3 Tl„, N 
«^vidualou.p„, Signals AW, BM .... B^-Jof Oiearnyof ,«ona.o« 13 arcfo^anfcd 
.o.^.sm«.or 15.m,.c„nsunc«>rassignsa.i.dividual weight «.,M.),o^^ 
fteNrndividualoutpM signals S/,! .... V-; to g.ne«eNindi™inal weighted 
OU.PU, Signals. Fn«hennore. .h. ,ec<»«m«or 15 proWdes for a snperposito of these N 

n>dividualweighted«..pu,signaIstoge„e«teMou.p«signalsCrf,;, CM.... 
MshHic„M=l.2^..). 

Thch,™Uonli.sin.hefi«.«,,ephc..^U<»a,signalp.««singapp™^ 
imed for exanvle on Fonrier or Uplac. cansfonns. di«c.ly by ±c r^ponse of a 

«,naUon, d,a, selects certain sp^tral featutes. Tt. advantage of the invention 

limits simpUcity.its flexibility with tespect to spectral tesolution. which may itself 
depend on the fieqnency region, and in nearly eliminated time lag between input signal 

A(t) and resonator response B(t). 

15 •"^P-en.methodologyeanbege.eralizedtoresonatorshavingarbitra.yresponse 
liincttons using od»r differential equaUons for the testator response or their 
"■nesponding phy«al implementaUon. Tie differential equations are not limited to second 
order. 
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The resonator array may comprise A^D>rentzian resonators, or any combination or 

anangement of ^I^rentzian resonators that are connected or coupled so as to formy. 
resonators, or A^non-Loi^ntzian resonators, or any combinaUon or arrangement of K 
non-Urentzian resonators that are connected or coupled so as to form A. resonators or any 
combmation of I^rJ^tzian and non-U>.ntzian resonators so as to form I, resonators (with 

^^-^^.^-f^)-PIeasenotethattheresonatorscanbeimplementedinhardware 
25 software, or a combination of hardware and software. 

Ir. known FFT-based signal analysis the response time is given by the lowest resolved 
frequency for al, Fourier components. With the present scheme, the response time is given 
directly by the decay time r, . which can be selected at will and for each resonator 



SZ 9-99-025 



12 



15 



tune resolution is cnicial. 

- Of U„ ^ ^ ^ ^ ^ ^^^^^ ^ 



ofH^ .Csmo^generai to,«„.,,^2and 12ofH^ Uand IB 

-^de„. U is example conceivable ^ ^ v»c«.pho,es each of which 
provides an input signal AM to the system 16. 

^^.e™ta.„paons.ose.«ateor<,eriv.thei.i„«signa.smTl««si.naiscanbe 
generated or denvedftom 

- the input signal(s) A(0 (in a feed forward fashion), 

- the A/ output signals C(t) (in a feedback fashion), 

- any signal inside the signal pix)cessing systems 2. 12. or 16. 

- another signal processing system, 

- another reconstfiictor, 

- another resonator array, or 
-a computer system. 
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13B. Ttcx Figures comprise coimneiils in brackets ( ]. 

used » describe tt« betavior and p„>p«,es of each of d« ;v .esona^^ or . 
u„» decay cousin. u^N, and „f ^ 

ll»n a se. of constants acc calculated ...ow to represent Equadon (2) in a.e fonn ' 

10 'B'('+A) = «o,B<« + «„,ft(,-A) + „,rA(/+A)-A(,-AH 
2<*--besthebebaWorof,,.= ^^^^^ 

-^.des* ^dWiniUaHzedtoze.o.No.etbattbeB,uaUo.(2a)isactu^^^ 
^ own heated by reference „„„.ber 134 in .3B) in d. psendoJL and 
not inside the fust loop 130-13 1. 

^-^(.ref^ncenun*e.,35)i.rese.w,^„nnins.bn,u,b.bis,oop,,2.,33fordl 
^Un«.7,n3..ecessao-.b.cause.bes.acic .35 wouid othe™ise be undefined. Tl,en 
d^erence ^r^ o, .be >n^. signa. . a. two tio^ steps is dete^ined. T,» resonator 
ampbuades a are depending on the actual of <v,ri«. 

20 If tbe weigbts (.e^,>u,m are constant, tben fl« output signal ccan be calculated rigb, 
away by weighing jnd supetposing tbe individual resonator output signals, tbe we^ 
2*«^are„o^„sta„t.tben.beybavetobeca,cula.edbeforeweig^gacc.^^^ 
^^urea„dsupe,p«,„g.Hei„dividua,reson.o.o„tputsig„als.No.e.bati„tbe 

25 Zs ° '"'""'"^ —output Signals are supetposed by 

means of adding them. oy 
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i e senn^nfjoii t u ' ^' ^ ^' "■' ^^'^ after the other 

aigiBl hsanng aijas a working embodimem. 
25 A. high ft^oeneies ^,„,„„ ^ . 
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In the foHowing section the fi^uency-dependent signal an^Hficationo^ 
descnbed. Hearing aids amplify certain spectral regions. Existing technology uses Fourier 

transforn. of the input signal on short time intervals. This technique inco^^^ 
time lag between input signal and the synthesized output signal, which is inversely 
proportional to the fiequency resolution. Fourier tiansformation requires inher^ntiy to 
compromise fiequency infozBiation witi, time information. This is problematic because 
speech exploits both extieme time and fr^uency resolution simultaneously.Tl,^^ 

signal is synthesized in the traditional approach from scratch using the Fourier back 
transformation. 

According to ti,e present invention, tire audio input signal A(0 is only enhanced using a 

resonator tiansformation. and the frequency informationsuch as ti.epi.ch remains 
mtact. because tiie resonator osciUateswiti.ti.e same frequency as ti,e audio input sig^^ 
m. Thrs approach mimics to some extent ti. human hearing apparatirs. i.e. tire cochlea, 
which can be looked upon as a complex resonator array. 

Hearing in,>airment is characterized by elevated Uuesholds for tiie detection of sounds 
qmet A typical example for tire hearing tirreshold curve 30 of an impaired ear is shown 
Frgure 3. A prominent characteristic is ti.e steep increase of tbe hearing tiueshold above 
200 Hz witii a first maximum of 50 dB at 1 kHz (reference number 31) and a furtiier 
mcreaseoftiretiuesholdintiie ,0kHz range. Despite tiielossinsensitivify^ 

intensrty might sound equally loud toahearing impaired hstener as it does toanormaUy 
hearmg hstener. In oti,er words, tiiere is an abnormaUy steep growtir of loudness witii 
mtensrty m tire impaired ear. This phenomenon, called recruitinent. is illustrated in Figure 4 
Because of recruitment, restitution of impaired hearing cannot be accomplished by means 
of a smrple linear fijfer which compensates tire loss of sensitivity of tire ear. In order to 
preserve a natural perception of loudness. ampUfication of tire sound intensity at a 
partrcular frequency must be adjusted according to tire hearing tirreshold and according to 
tire momentary intensity at tins fiequency. This process is iUustrated in Figure 5 In panel 
(a), a whrte noise input spectoim with 0 dB intensity is considered, meaning ti,at the noise 
.3 just at ti,e detection tirreshold for a normal hearing person. Note tirat the curves on ti,e 
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■-lev.. Of SOdB (seepage, (a),. wMchcc^sponds . a. loudness of a „on„a, 

™o„.«.sou™,p^a.tt«ta,pai^ea,„o„,dbei„excessof.OO<ma. 
ftequencies above 1 kHz. 

^'"--^•-■«.-<*aso»dteve,ispe„.ivedasexUe„«,y,„„aif„o.painft^ 
^e„^,«sca,e<.fo,exa„^,esuch«..d»pe:ceive<.,ouaness,eve,is60dBf„a. 

2^w.„^co„.po„as,o.hesi.uaUoadepic«di„Hgu.4.P™„«.<,ashedcu.e4,i„ 

^F.gn„4oneca„co„o.„dea.,d.eph,.o.osica«yco,^«>^p_^,,3„^^ 

oa^wo^,anan^.^„„„f30^^^^^^„,^^^^^_^ 

^^s..,oUows««,u„scaHngWo™aao„f„,U„ea._i^..,.^^^^ 
coa.pr=ssu,n of a= amplificalion anve according «> 

(5) 

^.seeB.„.4)f„re,na„o„dncss,«^„„o,^^,„„^^„^^ 
^d-^Uo„of,ca<son«,sig„a,s(c„™«,52isno.^^^^ 

fiDmlhehcanng(Rresholdcurve30(seeKgure3). 

T^„. ™ .^sfo™ n.^ , ideaU, sui^ for i.p,e™cn,„g aco«ica, signa. 

as ,. p^vidas a „a.„ra, pad, for in,p,c,„e„.„g f„.. w^ch Cose.y 
resembtes d,e way i„ „Mch .Ke c«:h.ea of U« ear ope,a.es. U » be emphasized a, .his 
d«ccc.eadoes„o.perfonnasHa.pPc„Hera„a,sisofsoondig„.s.:is" 
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u»ofdBocc„,^*i„„Umsecood.inm«™,sc»dswhichcal,.forar^idly^^^^^^ 

• I»=f«*lyWowlO.Asui«d«ng=fora«Q-ftc«risb«wecaIa«I5. 

Rg«re6dcscribesah«ringaidcmbodin«„.AbI«kdiag™nofd»signa,prc^ 

..^ of .6^, „ . ^ = 44. . !,„ ™. ,3 

vaheo,to™,^^^„^j^^^^^^^_^^_^^__^^^ 

«. . - 64 J, before d.e weighed .esoaa^r Tamfonm O^m .efened .o as ;.i„divid,«l 
we.gta^ou.pu.si|^)a:ecoo*i«dtaU.e«.pe,po.Mo„e«^«,oforn.U,eo«.p„, 

each:esooa.orW„n,,andfh,„tedK=opU™„naa,plificado.a.dysfte,«e^ T1« 
cata^,a«oa„f«.fi,^<^,<„,^^^,^^^^^,^^^^ ^^^^^ 

symhes^ by a„ app^^^^aon otoi. 62 «, p^iuce an an,punca.o„ as given by fte 
■»«antaneousf,eq^cydepe„de„.sonndp,ess„«<,ta,>.R,„ki,p^ ^ 

61. 1-6I.N and 62 serve the dynamic calculation of W/,). 

;~~""'"""~'^"^''°"'''^'-----»«Sivenas 



in 



IS 
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i«»nator UMrfer ftocSon being gi,a, by Equalion (3). 

•^■■n^ have a c«.,an, Q-l^ofi and resonance fie^ueocie.^, a« 
^ganaualcaUy spaced over «,odeead«be«veen .00 and ,^000 „. TT« ourpu. signa, 
CW IS a linear superposition of die resonator tramforms 



(6) 

~c weigb. are real nnn^ers. Tiey are calc^ared s.b rba. flie desired .ransfer 
^r^ocs Of me signal processing sys.e„ 60 is obrained. CalculaUon of Uie ^igb« 

involves .„o steps. FirsUy. in each sampBng i„.«va, .be mon^nrai, m« SmcUon is 
derermmed by circnirs 61.1. 6 1.2 61 J., and secon^y. .be desired m.er funcion is 

approxinialedinanapproxirnadoncircuir^byu^ resonator responseiiincd^^ 
leas, squares fi. procedure. No.e die cireuils and odier element of Figure 6 may 

™asoftwarein.plen«n.ado„aswellasabard,^in,p,.^^^„,^ 



15 scheme. 

^.adonofd^fl,.erfbncUo„bycin:ui.61.1.61.2 61.K is described in connecdon 

2* F-S™ 7 wbicb sbows exemplary element of one sueb uni. 6I.i. d. evalua^on of 
y fUte fimcuon a measure Of u« s^nd piessure i„ each resonator ttansform is 

20 ^rT™''^''°'''™'^°°°'^"'''"'^'''^'-"-P--'>vera 
so aia. die systor^can sbu. off amplificalion sickly to avoid damage to die ear. For diis 

Z^' '^r^' ™ "> '-^-y ^'Snal 

/«.™en,d.signai/„;isspli. into .wosignalsa.71.0.ofdiesigmds/„;is processed 
diougb a lesonalor 72 d., has non-ze. damping „idi a . i. die range of seconds. THis 

irz'ft'''"'™'''°"'^'^~"''*~'^^'^>'---^^ 

.ogandun of .he resuU is «,en by a uni. „. The ,ogari.hm of .he second pan of signal 
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UO - as generated by unit 74 - is transformed using a similar resonator 75 wiA zero 
fiequency and a damping in the range of milUseconds. The second resonator 75 is faster 

than the first resonator 72. The two processed branches76.1and76.2 are combinedm^^ 
n^ure<I>oftherelevantsoundpressureatthefi^uencyoftheresonatortransform^ 

me combining of signals is done by unit 77.TTUS sound pr^ur^ is then used to determine 
the filtercurve at the given f:«,uency adjusted to the soundpressur. according to Equation 

(7). This is done by unit 78. Theoutput line 79 isconnected to the approximation circuit 

62. 

The intensity of the i-th resonator response/.r/; = BKOcorx.sponds to Uie spectra 
of the input signal A(0 at ru, averaged over a frequency band of width rv,/Q. For each 

resonator an averagedlogarithmic spectral intensity, </,> is calculated which is de 

the maximum of the logaritim^ofaslowrumung average of/,r/;withatime constant 
r, = 0.5, (resonator 72) and a fast running average (resonator 75) of the logarithm of HO 

withatimeconstantv = 5«,forrn,>2;r.400^^andr,= 5m,.2;r.400^^/a,,for 
r..- < 2n < 400Hz (note tiiat taking tiie logaritiun of the average and taking the average of 
the logarithm are inequivalent operations). The running averages are obtained by means of 
a recursive summation algoritim. in which the output of step n^l is set equal to the input 
multrphed by a weight l/Ar,/pius the output of step n multiplied by a weight AT,,- l/N., 
whereA^„=/,,,,isthenumberofstepsoverwhichtheaveragmgisperfonned The ' 

mtensity algorithm is designed to foUow fast intensity peaks quasi instantaneously 
the same tmie it also provides a measure of die average sound level. In accordance wid. 
Equation (5) tiie transfer ftmction F(c..)of tiie adaptive filter sampled at n,.- is derived from 
the spectral intensities </.> using the transformation 

P'CoJi) = Fo(tZ7/)<'^'^'*">«) 

(7) 

where Fo(a,,) is die hearing threshold of Uie impaired ear at rv,. Thus recruitment is 
mdrvidually accounted for in each frequency band that is sampled by *e corresponding 

resonator. 
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11.edesi^mtert.ansferfi.ctionisdefinedon,yatthe™^ 

Tl.eco.pIetetn«.ferfoncUonisinte^,atedusingannearsu^^^^^^ 
response functions and imposing the minimization criterion 

a; jiv J 

|(||:C/?/M--i^C7;))2=min 

one .teradon step is perfonned per san>plmg tattnral. Np« am U« Alter iuncd„„ is 
conflnao>.slyupda.«i<,uri„gi,era«„,l„^^i^„„^^^__^^^^^^^^^ 

ccn^ which is used for a» synthesis of the outpn, signal (see Equadon «. 

■^'^-'-ringaid^stestedwid.a.estpe.s^.fton.whom.hehea.ing.hreshoid 
c„n.sho™inF.gn,e3wasav,ilaMe.Theovea,lp.rfon„ancewasve,yposidve I„ 
pamcuUr. comp,eh««ibility of natural speech was better than wiu. d» test person. 

conv^Uonalheatingaid. -lie .es.pe.son was able tohear sounds that wetenotknown to 

tan t«fo«.TOs is an indicadontathe high frequency gain Of standaMhearing aids is 
kept tad^r low on purpose in order » suppress painfull, loud sound le^ls at d« ear. 

15 ^^•"^a-in.plen.u.adonofd^adapdveffl.erCapseudo^rtK.gonalbasisto.cdon 
flUer 80) ts shown i„ Hg„„ 8. I„ „^ ^ i™plen«ntadon of a hearing aid using 
neariy non^verlaping ft«,uency responses is in>plen»„ted. By suitable supen-osidon of d,e 
ATresonaror transfonns in a mi^g nBdix 83 with weights A/ij/. f, „c„ resonator 

•--f<«--co„s.„,cted. Which ha« a narrowerftequency response. TteLo^noi^ 
.esonato. 82 toged,er wid. d,e otixing „.a.rix 83 fo™ a no„-Lore„.zian .esona.or array 

AS each .esuldngJeso„a.or«„„fonng,«(se. of quasi^ogonal basis <U„cdo„s)is 
^ .n a nar^w fi^uency domain, dte coefficients C, in B,uado„ (8, can be taten to 
be fto). Hence, only the fUter fu»*„n needs to he calculated by units 8I.1-81.N and the 
symhesis of UK HIter (um:don is just an idendty ttansfonn. 

25 The basU functions are linear supen>ositions of resonalor dansfonns 
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fUn«i« by ctauoy 81... 81.2 81.N is sW^h. fo™a,d. Tie ou^, .ig„al i. a 

b«.g e,^ U. desixed a^plific,™ „f ^ fi^. „ 
10 IS illustrated in Rgune 7. "iui<« 

8^ ceater fie,„e„ci« of fte bash funcdons arc again logariMcaUy spaced over a 
fiW range fio™ 100 H. ,0 10 ffl. Tie cba^c^Hsdcs Of a„ basis ^^^^ 
'*-^y'-™aI.,e„..ianUneshape„iaaQ-fac«.„,3i„alre,„e.cyse^^^ 

-,±-,/e.ave,ysto=pgain,oll-ofrofl00dB/decadeond«I„wfte,^3ide.a„da 

n»de,a«gai.„,U^of40dB/decadeonteUghf«,„e„cy Side, ll^aggr^sive low 
«-q-acya«e„„ado„ is needed in o«ter.ocop«wi«,d«s,^^p„afe„,^ 

««vebetw.en2CK)H.and IMbwhichconesponds^aslopcofSOdBperdecade To 
J.aeae„uoding,«,«.sa,a,,ese,of«= 100 resonator «nsfonns is needed for 
*e ^«bes. of *e basis ..cUons. Sin.„,aUo„s show «^ a value of 3 is a good choice for 
■he Q-ftc«>r Of a,e resonawr -^for^s. Tl>e conesponding rcsonanc fi»,„encies arc 
logar,d™ieaUydi^b„.edbe.wee„ '<» Hz and 10 k„. in analogy .od. basis fUncUons. 
-n-erc ^ varions ways u> conplc d. heah„g aids, as described above, wid, Ure hu„,a„ ear 
one approach is iHushaled in Fig„„ As shown in ftis Hgnrc. U« hearing aid con^rises a 
s.gna^ processing system 91. according ,„ d,e p,cs«,. invenrion. which receives an inpu, 
-gnal A(0 (e.g.. an acoustic signal) via inpu. 92. The signal processing system 91 n«y 
compr^e a signal processing system 2 or 12. as illustrated in Figure , A and IB 



SZ 9-99-025 



22 



20 



25 



"spectively. o„* „. sig^l Q,) u fed via ou^.. 93 » an interface oi^itt, 90 TWs 
««erface ci™,in, 90 p„,vid« an interface between .he Signal p^c^sing 9, ^ , 
hununbei.g.Infl,ep,esen,enrt«dio««.ausinterfaceci,cniay9^ 

'^»'>^"PUfi«*eaig„a.a«andal™^er95.TT,elondsp«ac.r95isdesig.ed 

suchd.,itcanl«eiaterpIac«irigh.nex..oU«earorwiUnn*eear.11eio„dspeaker95 
feeds an acoustic signal into the outer ear. 

Anther app^ri^isillusttated in Fig„.,O.Assho™in,hisFign„=,U»„i,a„i„terface 
cn«na, ,oo inte«cts direcUy „iu, U« h„n>an l«d,. Tie interface uni. 100 «ceives 

™i.pu,li.el02M„u,p„signalsC,(0.C*) (VO ftom a signal p,c««ing system 

^nimg ,0 ae presen. invention ( where M c N). The signal lines 101 can be connected 

especial in^lancs .02 U«,a«sin.ated in tt„i„„erpar.ofttteear.Signalsa^fed via fte 
signal lines 101 .o the implancs 103 such *a, certain segment in ttte ear 104 a« 
«i-uIa.ed.Tles,in„aati„no,.heea.hymeansofi,nplan.s lOSisnsedifapet^isdea, 

orpattiaUy deaf. Nowadays, in ce«aincaseselec,^ateevenin,to,,edi„to,he inner 

ear dnecaycoolacting^e nerves of ,heear.lnthiscase. the interfacecirc^trylM 
be adopted snch that the signals on signal lines 101 a« suited to stinndate 0. netves 
For this p«nx»e. the interface circuitry 100 may comprise a p™=essor which 

processes the input signaiayso as togenerateelectdcalpdseswhichcan be direcUy fed 
|» the unplaced electro, present invenUon help, to improve cunent hearing aids 
because rt provides a mom reUable and more nantral way to process input signals. 

THte hrterfaoe circuitty may also be used to connect signal processing systerm accotdmg to 
U« present mvenUon ,„ a bade end system, s^h as computer, telephone system, hearing 
M speech recognition system, speaker recogmtion system, or a pervasive computing 
dev.ce, for exam^ The interface circuitry can be realized by means of discrete elements 
or ., can be mtegrated into a chip. V. interface circuitry may comprise a microptocessor' 
multrpiexers/demulUplexe.. parallel-to-serial converters, serial-to-patallel converters 
analog^digital conversion circuits, memory, and so forth. 

In dte present embodiment of the hearing aid. the orthogonal basis function approach is 
numerically less efficient than the direct resonator transform merhod even though no 
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i.««ive algorifto. tavolvcd However, i. .ppBc«io„s „Uxed »ea„aUo„ 

eZir'™^-'^^"°'*^"'-'-^'^™'---»-^-p«'- 

»y^.Thesesp.ech.ecog„iUons,s«»a„u,ed«,^Ufyu.p„,„fco™^ortex. 

m»<»mpu,er.ys.e„«.f„exao*,e.Abohandicappedpe^„.^„o„3™,oK^o„ 

^ca,a„de,ectfcal.ppa™„3whichcanbeope™edbygivi^>eo„sdcco„ 
^™°'^P«°^.--<n«k^ve.,,ecb^eia^.„d«^„i„^^^^^^ 

and «l«ble speech .ecogmdon qrs^^ e,,abled by the p„».„t ta^^^ 

Asp««h^,^U«,,^^^^^^^___^^^_.^_^^^^^^^^__ 

a se. of descnpto. (tenned cues) ou.put by inveadve signa, p^i^ sys^n. Ms 

s.g.«^p,.^gsys.emisen:p,oyedasfh>„,e„dU«.Uaasfon^avoicesig„al(i^^^ 
^inal AW) i„.o the se. of descrip«,.. tUs se. of descripu,. describes certain 

cha^ac^nsac p^perties of tte voice signal (in,., signal A<Oy T1>e se. of descripu». can be 
con,pa«d w,d. Urfonnaaon s».ed to a knowledge database or a fining database If a 
matching set of descdptots of found in the database, then the conesponding vowel 

~sy.,ab,e.or„o.d™ightbereh^df<.,teherp™cessi„g.l,.d;«^^ 
a speech recog^Uon sysKm can be nmch smaUer ftan d« one of known systems. 

The presen. si^al p^ce^g sys^n. is weU suited ft, use to speaker tecogniUon systen. 
A speaker tecognition system is a system which is used to identify a speaker by i« voice ' 
lias ,s .mportan. systetns where some idenUScaUon of *e user is required. Examples 
are access systtms,yutoinated teUer machines, and ttie like. 

is ako a demand for acoustic detectors which ate designed to detect a particular 
no.se or sound. Such a detector could for example be used te i««cate whether an engine is 
about ,o be destroyed, or to detec, acousUc signals which can «herwise no. be detected by 
ftc human ear. In noisy enviromnent. e.g. m a cockpit, it would be useful to reduce or 
chm,„ate noise so as to ensure that voice and other signals can be better undetstood. Such 
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" """^ ^"^ ->i« ftom Sres. for 

10 resonator 110 is: 



(10) 

wh... .z,, is Ae resonance ftequency witt,«e damping, and Uk Q-faaor is 

(H) 

Onecaa nseA,s„ch„=sona.o« .10 .o buUd a ™r anay 120. as schemaUeaUy 
U.^ in Fisu. ,2. .^fe,^,,. ^ ^ ^ ^^^^^^ 

Q-fac.orand,«o.anc.f«,„.„cy.taRsu:e,2U,e„a,e;.i.divid„a.ou.p«si8naisB,W, 

firf* Eacl.ofU»s.Ari.divid„al«,pu.signals5rf,;, B,„. .... fi^«isften 
fonvard«l ,o a ,eco.sm«u,r 121. -nns „cons«,c>or p™.id« for the weighting and 
supenxKidon of signals such *at M ompw signals Q,, are obWned. 

AS n^nuoned Oer above. 0. presen, .heme can he nsed for *e processing of any kind 

ofs.gna,s..fas«na. processing sys«maccording«,.hep,esen. invention isdesigned^. 
cperare on electiical signals and if an aconsric signal is received, rhen some sor, of 

mrcrop^one of orher means for rransformation of .he aco^Hc signa, in.o an elecrtical signal 
forma. . ,e,u^. a microphone is an e,ec.roacons.ic .ransdncer which convert variatiL 
.ound pressu. in» an equivalen. e,ec«ical signal, which ti,e„ is fed .„ tire signal 
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procas^ngsyslen. AnymicroplK>„eisweUsui.«iforu»=iac„.necdonwtta«g„al 
processing system according to the present invenaoB. 

Tl«p.ese.tinvc„ti„nc«bere,li.edtahsrdware.soft™,«.„racon*inaU^ 

---'^-Anykindofcomp„.ersystemor„therappa,a«.adap.edforc«yi„gou.d„ 
5 "»«»*<^bedh.reiniss„ited.A.ypicalco.nbina.ionofI,rdware.odsom,are^^ 
be a gen«al purpose contpn^r system with a computer program .hat, when being loaded 

and executed, cont^ls the computer system such that it carries out the methods descdbed 

h«em. The presenttovenuon can also be embedd«linacomp„ter program product, which 
compdses a« the features enabling dte implementadon o, the methods descril«d herein, and 
10 whrch - When loaded in a computer system - is able to carry out these methods. 

Acomputerpregtamorcompaterprognnn means intheptesentcontext any expression. in 

any language, code or no.adon.ofase. of instrucUonsmtend^ltocauseasystem having 
an .nfonnaUon processing capability to ,«fonn a particular function either directly or after 

''^erorbo.hofdtefollowingajconversiontoanotherlanguage.codeorno.ation^b) 
15 ■q»oduction in a diffeient material form. 
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CLAIMS 



comprising: 



1. A signal processing system for piocessing an input signal, 

a plurality of resonator., each r^nator having parameter, characterizing it, for 
piocessmg the input signal to generate N individual ou^ut signals; and 



a reconstructor 



for weighting each of the ATindividual output signalsusingacorresponding weight 
to generate AT individual weighted signals; and 



for superposing the individual weighted signals to obtain A/ output 



signals; 



whecebyA^.NandMeN. and whereby „„=„fu,epanun=.e.ortt«„eightisa,» 

dependent. 

2- The signal processing system of claim 1, wherein one of the iSTresonators is a 
Lorentzian resonator. 

3. signal processing system of claim 1. wherein one or more of the plurality of 
resonators are Lorentzian resonators, and wherein the iVindividual output signals are 
fed to a mixing matrix for coupling of these A^individual output signals. 

4. n,e signal processing system of claim 1, wherein the plurality of resonator, form a 

dynamic filter array. 

5. The signal pro^ssing system of claim 1. wherein the weight is time dependent and 

frequency dependent. 

6 Tl« signal processing system of claim 1. wherein ,econs«.c,„r comprises cuc.;^ 
for dynaniicaily calculadng U,e conesponding weighB used for weighting each of >he 

N individual output signals. 
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7. The signal processing system of claim 1. wherein the i«:onstructor superposes the N 
indrvrdual weighted signals by a mathematical operation selected ftom a set of 
operations consisting of addition, subtraction, multipUcation. division. 

8. The signal processing system of claim 1 . wherein the reconstructor comprises an adder 
for superposing the iVindividual weighted signals. 

9. The signal processing system of claim 1 further comprising an interface circuitry 
servmg as interface to a back end system 

10. TbesignalprocessingsystemofclaimLwhereinthebackendsystemisahearingaid 
or a speech recogniUon system, or a speaker recognition system, or a pervasive 
computmg device, or a computer system. 

11. ^^^^g"^P--e3singsystemofclaim9.whereintheinterfacecircuitrycomprise^ 
amplifier and loudspeaker. 

12. The signal processing system of claim 1. wherein one of the plurality of resonator, 
compnses a coil, a resistor, and a capacitor. 

15 13. H,e signal processing system of claim 1. wherein one of the plurality of resonators 
compnses a micromechanical element, preferably a cantilever. 

14. Hie signal processing system of claim 1 . wherein one of the plurality of resonators is 
r^zed by a combination of a processor and a code that embodies an algorithm for 

execution by the pnx:essor. 

20 15. -nc signal *««tag sysKn. of data, 1. wh»i„ *a plurality of ,csona«>„ and U,e 
.«:onsm.c,or are .eaUzed in a compurer system con,pristag a processor and a code 
■bar when execured by the processor generates the M output signals. 

16. Thesignalprocessingsystemofclaiml.9. 10. or 15. wherein the input signal is a 

voice signal. 
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17. The signal processing system of claim 1 or 1 5, wherein the M output signals represent 
a set of descriptors which describe properties of the input signal 

18. The signal processing system of claim 17, wherein the set of descriptors is usable by a 
speech recognition system or speaker recognition system. 

19. The signal processing system of claim 1 or 15, wherem the ATindividual weighted 
signals identify different vowels and/or classes of consonants. 

20. TT,e signal processing system of claim 15. whei^in ti.e code embodies an algoriduns 
for generating a descriptor sets for use in a speech recognition system or speaker 

recognition system. 

21- THesignalprocessingsystemof claim 14 or 20, wherein the algorithm represents a 
differential equation, preferably a second order equation. 

22. nxe signal processing system of claim 1. wherein there is more ti,an one input signal. 

23. Tlie signal processing system of claim 1 receiving L time signals which either make the 
parameters or the weights time dependent and wherein L e 

24. TTie signal processing system of claim 23. wherein tiie L time signals are provided by a 
resonator, a reconstnictor, or a computer. 

25. Method for processing an input signal, comprising the steps: 

processing die input signal by means of a plurality of resonators, each resonator 
having param«ers characterizing it, to generate N individual output signals; 

weighting each of the individual output signals using a corresponding weight to 
generate individual weighted signals; and 

superposing the N individual weighted signals to obtain M output signals; 
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whereby A^e M andMe and whereby one of the parameters or the corresponding 
weight is time dependent. 

26. A computer program element comprising: 

computer program code means to make a computer system execute procedure for the 
processing of an input signal by: 

processing the input signal to generate individual output signals; 

weighting each of the ATindividual output signals using a corresponding weight to 
generate N individual weighted signals; and 

superposing the A^individual weighted signals to obtain M output signals; 

whereby either for the processing of the input signal or the weighting of each of the 
individual output signals the representation or equivalent of a time signal is used. 

27. A computer program product for the processing of an input signal, said computer 
program product comprising a computer readable medium, having tiiereon: 

computer program code means, when said program is loaded, to make a computer 
system, execute procedure to: 

process the input signal to generate iVindividual output signals; 

weigh each of tiie individual output signals using a corresponding weight to 
generate N individual weighted signals; and 
r" 

superpose the A^ individual weighted signals to obtain M output signals; 

whereby either for the processing of the input signal or the weighting of each of the A^ 
individual output signals the representation or equivalent of a time signal is used. 
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ABSTRACT 

Scheme for processing an input signal A(0 by ATiesonators (17). each having parameters 
characterizing it, to generate individual output signals. Then each of the ATindividual 
output signals is weighted using a corresponding weight to generate individual weighted 
output signals which are superposed to obtain A/ output signals C(t). One of the parameters 
or the weight depend on a time signal P(t). 
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HG. 13A 

In^plementation example: 

[read discretization time step] 
get dt 

[reset oscillators] 
130 for each N jioop over resonators] 

get omega (N) [read frequency *2*pi] 
get tau(N) [read time decay constant 1 
get weight (N) [read weight] =°"stant] 

Uo{N)= (2-(omega(N)dt)») / (l+dt/tau(N)) 

[one exanple of equations describing 

^^^^^^^ 

Ui(N)= dt / (l+dt/tau(N)) / tau(N) 

[u are constants] 

bO{%*=0 tkI? ^"^^ ani>litudes of resonators] 

amplitude of previous time step] 
done with loop over N " amplitude of actual time step] 

[loop over time steps] 
for each t 

input ap [read input signal a of the] 

[next time step] 

if (first t). then [the first time, reset stack] 

[for input; otherwise a would] 
135 ao=ap ^^^^^^ defined] 

aia=%p 

end if 

[calculate difference aprime of input signal a] 
aprime = (ap-a^) 

continue with FIG, 13B 
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FIG. 13B 

continuation of fig. 13a 

[propagate resonators; loop over all resonators] 
for each N 

^ = Uo(N)*bo(N) + u„(N)*b.{N) + Ui(N)*aprime 

[Jtlp?^''°'' following time] 

= ^^^^ ^^''^''^ " updated/shifted] 

done with loop over N 

[as Ti^rS^ oJ^Ktw]"^'^^^'^^ ^ recalculated, 

[In this iinplementation exa„,ple the weights are constant] 

louiinl tttnlT^)"" resonator output signals to generate] 
c=0 

for each N 

c = c + weight (N) *bo(N) 
done wxth loop over N 

[reset stack for input] 

ao = ap 
[output output signal cj 

output c 

133 ^^^^ with loop over t 
end. 



